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ABSTBACT ' A ^ ^ ^ 

. , This paper discusses the relationship ^betveen 

I language pfoficiencr inl^lligence. In particular, the paper is 
concerned vith 'i!he elesents of intelligence testing jfbich creep into 

. tests desighed to deter sine lAnguage prof icie.ncy, and 'the ' 
proliferation, of testi|ig of , all types and. the kinds of 
interpretations sade of thes^, iests. Particular ^reference is sade to 
the non-native adult speaker of English vbo is fregu^ntly. Bub ject to 
these types of tests, lative^speaket data indicate that the reading 
section of the Test of English as a Foreign Language "llTOEFL) presents 
difficulty fox the native, and nonVnative speaker of English aliker 

^ and that both groups find this jsection 'thet sost difficult of the 
test. A cosparison of n)EFL aqd Graduate ^cord Exaiination (6fi£) 
scores for foreign students applying for adsis^ion to Texas ASH^ 
Oniversi^y did not. show a very higl|i correlation. A Svedisb'vstttdy ' 
vhich atteapted to exasi^e the relationship between prpficiency in 

^ English as a . second language and various intsllil^enciB factors was 
also unable to find hi^ correlation betveen the tvo types of/ test. 
Indications ate that the GBB and sisilar tests are not appropriate 
for detersining second language proficiency. Bore investigation is 
needed af the relationship between language ^and intelligenffe; in 
particular, joint research on thi$ guestion ^by linguists, 
psychologists, and seasuresent specialist^ is i^eeded. {Author/AB) 
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SeilTOFFlClAt NATlONAU fNSTlTUTEOf^ Paul J* AllSellS ' * ' 

* ,The purpose of this paper, ^as the title Indicates, Is ta raise a. 

\ ^ ^question. And, ^s Is the case In many Instances where questions are' 

. raised, there is often no. promise of* a satisfactory answer. But such a ^ 

fs* situation, while often intellectually unsatisfying, seems appropriate, in 

' • ' this case. Since t^c theme of this conference' focuses bxx frontiers In ' ' 
, / the field of , language proficiency tciatlng and dominance j it would appear 
^ • * li>-order to raise Issues which, at least until recently, have -been on the 

. ^ borders of at least two coniplemgntary fields' of inquiry: linguistics ' 

2 ' and psychology. Morg specifically, to focus on one qf the prihcipall 

-jb ^ " .points of emphaals at thld conference, it would appear both logical and ** 
• . ^ .necessary tq discuss the relatlonshltj between language pr^iciency and 
intelligence » V * * 

I f o not propose, however, to present any suggested models for what 
/ • this teiatlonshlp might be. Nor do I pfetend ^o evaluate any such models - 

which may already have been developed. On the contrary, my rem^frks stem . * 
from two concerns, one theoretical and one Vfery practical. Th^ former 
refers to my own curiosity concerning the elements of intelligence eval-l- 
Wtlon which creep into tests designed to determine language proficiency. 
The^ latter refers, to my concern over* the proliferation of 'testing of aU 
types and the eventual conflicting and som^lmes careless li>terpr1f tat ions 
Which are made of test results by counselors, advisors and admlnlstrdftors 
\ in general. Perhaps some knowledge gained > on the first point will, help 

to solve some of the difficulties concerned with the seddnd. 

- /^l will not be concerned in this ' paper >wlth the relationship of . , 
* i»tflllgence to language in chlj.dren. Mthough we are tar from any clear 

^ / answers as to what this relationship mi^1: be, enough has , been written 
^ on -this subject^ to at least- point the way toward revolving some of thfe 
' most immediate problems in this dcraialn. What I sTiall discuss is the 

(JV^stion of language testing and intelligence testing as they relate to 
jadults in a second language context.' In particular I shAll be con- 
; / * • earned with the Interplay of thes/e factors for Chose non-native speakers ' ^ 

* of English,^ who are most frequently subject , to these types of>testlng: 
foreign students in English medluto ins f^tti^t Ions of higher learning, our 
own college^ and universities. 

At least '.one other paper presented at this Aonferetxc^ has Investl- 
. / gated- the rolejof lariguage proficiency In intelligence tests (Oiler). 

* ' ' The first of my two-part question rai$es somewhat -the op^Josite point: 
. What is the role of intelligence in language proficiency t^iJ^ng? Be- 
cause of my acquaintance with the Teet of English as a Foreign Language ■ ' * 

KCrOEFt) and my role as a member of th5 TOEFL research committee, many o^ 
toy remarks will stem from a knowledge of current studies relating to that 
' test. Many of these studies are not yet complete and others are yet to 
v\^ . 1>« implemented but even looking at what^ questions are being investigated 

should, raise some interesting points for discussion. ' * • 

The first study, the only one for which we have som? actual data,' 
investigates the performance of native and non-native speakers on the ^ 
^ TOER test. The assumption underlylt\g i^st foreign language- tests, 

' including TOEFL, is that thu items inlcuded should represent features 

within the compTetence of all native speakers of the liTnguage* In the' V 
case of TOEFL, which la used to measure ^e Ehglish proficiency of non- ^ 
native speakers seek'lng admission to post-secondary academic Institutions, 
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a furtt^r restriction, however, Is -that the level ^of language woulll be\ 
appropriate for all "educated" native speakers of Englisli. the inter- 
pfetation of the word J^educated" is perhaps the source of^some of the 
problems we sh^ll. discuss. Buf basicall)^, what . is intended in such at 
teat la that it, would present no difficulty to native Speakers of the 
aaaa age and educational level as those being tested. 

Only limited research has been done tg validate thia^ statement . . . 
One *tudy by Angoff and Sharon (1971) did show that nativ6^ sfi^alcers did 
not seem to have any difficulty wit* .the items on the test\ But because 
no Analysis of items was doiie* as part of this study^and* alsd^ because a 
nev form of TOftFl had been, designed which incj.uded certain m6re f unc- 
imially oriented items types in both the listening compr-ehenslott and 
heading section, a tiej^ study was" proposed by the TOEFL research conmittee* 
early in 1976. ,Tfie subjects for^ this study were 88 cpllege-bound high 
school' seniors, all of whom were native speakers of EngVsh and who had 
little or no exposure to foreign languages beyond some lipited hifeh 
school gourdes. The result? oj^that limited study raise some questions 
w^icK relate to our topic' of language and intelligence. , 

The assumption once ajgain was that the college bound native spe^kera 
would have no difficulty with the test.^ One ah:6a of uncertainty,. hoWever, 
was the listening (XJmprehenslon section where pre-testing with non-ptlve 
apeakersNaeemed to show that the new "mini-talk" items werm»jre diffi^ 
cult than expected, ^ile the total scores ^achieved in the study indi- 
cated that the native speakers did well on, the test as a whole with 
mean raw scores of 134.4 and 134.9 on the 150 ItemMtest compared to the 
non'-natiye apeakers* mean raw scores o'f 89.6 and 88.5 respectively » 
listening comprehension section posed almost no difficulty for the native; 
speakers (Clark). Only 3 af lOOfitems on the two forms of this section 
of the teat had a pass rate below "80%; / • ^ 

In the Structure and Written Expression section, however, 22 items 
of the 80 on' the two forms of the test had below 80Z pass rates for the 
native speakers. Mo^*of thes'e were on the error recognition Items and 
dialt with points such as noun-verb agreement, Informational redundancy , 
and parallelism. To find so many cases of native speaker ^errors Is 
probably surprising. The pessimist^ ' (or perhaps wfe should sajTreallsts) 
amon^ critics of the tfutrent status -of^ thg American ediaatlonal. sys^tem 
'vould no doubt simply vClte this as confirmation of the sad state of our 
pupils* ability to use staiiliard written English. 

The Reading aad , Vocabulary seatlon, however, raises more serious 
problems. Here,. 22 out of 120 Items on the two f9rms of the test had 
below sot correct rates for the native speakers. Elghf of these were 
^ vocabulary itema ^nd although b^c^ such as '"broach" and "raze" might be 
explained on tj|f basis of low ff^^juency, others such as "scope^ and 
/•remuneratlon'^do not. It Is In^ tfie reacflng section where we begin to 
find an apparent c on f lift between factors, of language and Intelligence. 
Six of the items ln*^quest Ion dealt with factual Information but the 
t particular paaaagea were later found to deal partly with abstract ^ 
concepts. ^ Three others vera sentence restatement type Items.* But the 
.remaining flfve Items with less than 80% correct rates were^founfl to be. 
baaed on paaaage &i?nmarlzatlon.oi*^ interpretation. Thla ±a even more 
algnlflcaift when we note that, none of the * f lye had pass ratea near BOX 
(the range was from 67.44X to as low as 35/56t)* Also these five Items 
* repreaenfed one half, of the tlumber of this type on the two sections of 



the test. X^learly, the reading items oft this. 'type on the tiest presented 
an unusual amount of difficulty for the \a^^^^ speakers who took the 
test. ' y • 

. A closer look at the reading Items wikch proved to be the most 
difficult showerf'that they contained statefitents such as "It can be 
Inferred, the authoi? assumed," or^'*the author would* be most likely to 
agrt^". "rile performance of mHital proc^sse^whlch fpcus on inference 
an^ evaluation may Indeed *e part of what rewarchers view as ^"reading" 
but the fact remains that language tests can be constructed without 
Including 3uch Items. The choice of doing soVhoul<i prob&bly best be 
made after considering' native-speaker data soqh as those we have Just 
discussed. But a large part of such decisions would requiife-a^-clearelr 
understanding of the relationship^ between langune and intelligence than 

we now have . ' • \ * ' 

One other feature of thenaativ^^peaker stuo^ whldh- bears coament at 
this point is the judgment of difficulty by the ctodidates themselves. 
At the time of ^the test, the subjects were asked to check those items 
which* seemed unusually difficult or confusing. Alw, they were asked to 
indicate. their judgment of the difficulty of each section of the test on 
a 3 noint scale with 1 being the most difficult. FoV the riding items 
whi^ wete the most d^.fficult, the percent of c'andida|eQ who indl^zated 
difficulty ranged from a low of n.6 to as high as 22\2. On the test- as^ 
agvhole, the reading section was also considered to be\ the post dlffl- 
cult by the native speakers. Both from tile i*int of vljew, of the native 
speakers* judgments of difficulty and their actual perfS>^ on the 
test, .reading. was shown to be a problem area. At least In the Chomskyan 
sense, then, there seem to he fattors beyond simple' language proficiency 
which are playing a role here. We can otlj conclude thatwfcse factors, 
however they may eventually^be describe^ fwip part of wha\ we know^as ^ 

intelligence. ' ^ ^-^..-L^ . . • ' y , - 

One final o^ervation on the results of the native slpe^er study 
seems wotthy of - mention, r The strong disparity between the hijgh perform- ^ 
ance.of the nattvi;1ape^kers on the listening section ^of the t^Bt and. the 
lower than expected performance on other sections, particularly readiiig, 
seema to support; the distinction made by a number of. researchers, most 
tecentiy Krash^n (1976), between acquired and learned Hkills. * ;Slnce all 
normal persoiis ^cguit^e the ability ,to speak and understated their native 
language must learn to read and write it, it is not an unusual^ 
/)ccurence/to find that they will perform alkost to perfection in listen- 
ing testa bijt with some difficulty In at leas^t certain aspects or read- . 
ing and writing. An interesting extension of this distinction wpuld 
apply to teaching. It may be reasonable to assusie that studentfi can, be 
taught those skills in the target^ language yKlch even native speakers 
much leamVlz., reading and writing. But the same degree of sucoss^ 
nay not be attainable for those skills which natives regularly acqane : 
speaking and understanding.- ^ ~ 

t .* Another wi^ in which we can approach the subject of language and 
intelligence testing is to lodk fet actual tests of each type. Amon^ the 
tMts used with non-native speakers in an academic setting, two of the ^ 
most knowb are thc^ TOE^ test and 'the Aptitude test of the Graduate 
Recoyd Ei^amitiationB Board. The TOEFL test is designed as a measute of 
English proficiency and the GRE aptitu^^ test is designed as k meitsuref 
of general 'abilities neeessary for ^rtfduiite study. But becaiuse language 
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l8 £H« n^lOT through which aptitude Is .evaluater on at least half of the 
GRE test (the test Is composed ,o^ a v^rlial section and a, q^Liantitative 
s6Qtion)» students are— often cpnfused about thfs distinction. Moreover, 
' adMlsslons and otl^er personnel frequehtly use sc >res on tests such as 
the GRE as Indicators of a prospective student's language proficiency or 
scorei^on a test such as TOE^L as measures of future academic success. 
Ifr-^a ^ttenpt to get a^ clearer Idea of how these two testS, relate 
' to each other,,! have recently conducted a ^s-tud^l at Texas AfiM University 
Tdn which 1 cothpared the rWsults of scores whlchjforelgn students applying 
' for adnlsslon made on both the TOEFL And the GRl Aptitude tests. As 

Indicated in ?l*g: 1, the two tests, while not ccmplet^ly unrelated, do. 
. not show a very high correlation. ^ On the basis of this study aslng 
scorea of 91 studartts, the correlation coefflcl mt foj the tqta^ .scores 
1[>n both tests was .53; As might be e^^ected, the correlation between' 
the TOEfL scores and the/ GRE veirbal portion of :he test (."55) was 
higher than that between the TOEFL and the GRE quantitative scores (.31). 
ValJsdatlon of this fact can be found aiflong the nany fdrelgn students 
who, are extremely pt%flclent In mathematical, skills despite a lack pf 
proficiency In. English." ' ' . ^ 
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The ipean score for the 91 subjects on the TOEFL fest was 544 
(SD * 68.6), on the GRB'verbal 338 (SD * 81), GRE quantitative 604 
(SB ^ 121.4) and GRE total 942 (SD • 154.8), 

*A11 correlation coefficients 'are significant at the .0001 level 
^^._--.«cept th#«e Indicated by an asterisk.^ Thfe ^311 coefficient Is signi- 
ficant' #t the -.01 level but^he .134 coefficient Is not slgnlf i<:ant . 



^ A dcftter plot of theSe 91 palfs of scores gives a similar 
representation of how the two tests relate. But^ by dividing the graphs ^ 
In^o quadrants to indicate j|jigh and low scores for each of the two tests 
■ka even clearer picture ^erges (Fig-. 2) . ' 

• , Figure 2 . ^ " 

• ■ • • Comparison of High and Ldw Scopes 

A. TOEFL — GRE Verbal . 
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Wiin only the GRE verbal scores are compared with tjie TOEFL, pesulta 
there are no cases of persons with low langauge and high aptitude scores. 
And all but 4 of ^ the 91 pairs of scores are in the low GRE range, almost 
evenly divided -between those with high and low TOEFL scores. Increased 
language proficiency ^e^ms to have little effect on the GRE .aptitude 
scores, at least for non-native speakers. When the quantitative scores 
are added a more* linear pattern appeals. Sixteen of the" nin%ty-^ne • 
pairs of dcores appear in the low TOEFI^-Mgh GRE range. And Xwenty 
with high TOEFL scares (also falLirttKtn the high GRE range*. Again the 
low GRE licores are divided -almost evenly betVeemthe two TOEFL groups. 
Clearly,' the addition of the. *q\imt it active factor .produces a oueh 
balanced array of GRE SQorefi, This Is further confirmed by the 
correlation between* the scores on ^he quantitat-ive portion and' thfe' to^tal 
6rE scores while*^ohly a /M correlation-*was * founil betweep the scores on ^ 
the verbal portion and the tqtal GRE" scores (Fig. 1.) • 

If we IcTok. at tests such as the|TOEFL and ^e GRE aptitude from the' 
point of view, of their cont^rft we find a number -of ^differences which' 
explain to a l^rge extent the variation in th^ scores foiind in my study. 
These differences appeal: in three main areas:- Item types, quantity of , 
material on which .t'est items' are based, and the time a].lowed for the ^ 
candidate to take the test-. As far as item types are concerned both 
'tests are of the multiple choice variety. And dome Item such as those 
related to Hftenlng ctmprehension on the TOEFL do not apply to the*GRE. 
But uhere they\;are mord closely related l.e», ^n seeding and yo/iabulary,' 



the tasks presented to the -student are decidedly divergent. ^Vocabulary 
is tested Ai the TOEFL by asking the student to choese a synonxm for a ♦ 
vord In context i Reading Is tested , by asking the atudent to answer ^ 
queB,tionfi referring to pAftsageg ranging from 2 or. 3 sentencea'to no more 
than -about 150'wot4iB. 4^abulary Is usbd In those items on the GRE 
which attempt to test relationships (related ^paijrs bf words) including 
.ppposltes. Reading is tested on the GRE also by' asking the candldate^to^ 
answer questions referring to given passages.. But the passages are much 
Ipager and much more complex. * . ' ' ' * 

My examination of one sample GRE ap£itude test^ showed that it con- ♦ 
talnfed 6 conisecutive ' reading passages avera^ilfg ^20 words : in length and 
,2 additional passages tat^r in the t^st averaging 463 words in l^n^th. ^ 
Also the typ^ of questions aslced In -reference-^to" the p^^sages were 
primarily of t|ie infer At ial type. A sample are the following: \ 

1., The author is most cfoncerned witfi answering which of v • 
^he following questions? ^ • , 
- i 2. The author's approach to his subject can best bfe ^ 

[escribed as . , . \ * * - * 

3. T)\e style and content of ' the^passage suggest that it 
was excerpted from . ' t . ' ' , ^ 

4. Which of thfe following words best expresses the. underlying 
, : theme of the passage? 

» * 5. Whlc^l^f the following is least consistent with a belief^ 

^In determinism as the author defines the term? 

6. The tgne of the author's conclusions can best t>e described 

. ' as one of ■ . . ' 

7. with which of the following statements would the^. author . 

• most likely agree? / ^ . . . \ ^ 

The time alloted to co'mplete the items on the two tests 1^'almost 
the same if we consider only the verbal por;tlo» of the GRE. Thkt ^section 
of the test cdncains 130. items to^J?^ d^e in 100 minutes or 44 Seconds 
. per item. The Redding aind Vocabulary section of the TOEFL contains 60 
» items to jbe done in 45 Alnutes or 45 seconds, per* item. But glvei^ the 
much longer passages and the increised complexity of the vocabul^ and 
^riading items »Dti the GRf), ,tlme fian eastlly. be listed as a problem pr^the 
non-rnatlve speaker wh^n taking t^e GRE; aptitude test. - . ^ 

One possible problem with tiie Texas A&M study is the question of the 
time Internal between the adm in 1 Oration of the two tests. The maximum 
time span used^n tW study was 2\onthfi. All^of.the 91 subJecJirS had 
taken* both the TOEPX and^ the GRE* a^ltude test withiii a peivldd of no more 
than 2 faonths.^ Most likely tfiis ,f ac\or \did not affect tlie refsults a 
f great deal since 26 of the mibjects h\d 
month* Of the remaining 65 subjects 
* apart (of thfese 24 had talcen TOEFL fi 
26 had actually taken the tests as much 
\->^-TOEFL first and B the Gife first) > . 

The TOEFL research 'coimnlttee has rec 
to my own at Texas A&M but- which will be 



I 



\ 



♦ 



\taken both tests 'in the same 
(lad taken the tests pne month 
(and 15 tjie Gte* ^Ix^st) and orily 
ay *2 months apar^ (18 had taken 

thtly approved a s*tudy Similar 
io\e comprehensive both in 



tcnu of "the number of subjects and the tdst ,used.' Moreoy^t^^the pos- 
sible problem pf time should be eliminated by Shaving subjectptake the 
'. te»ts In question withirt^a very sHort period, ^Specif icaliy, the study 
irlll have as subjects 300 'foreign graduate students who will take both 
the TOEFli and the GRE, aptitude test* and, 300-foret«n undergraduates vho 
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will taker. the TOEFL «d the Schqlastlc Aptitude Test (SAt) of the 
College Entrance Examination Board. \ Also,, the undergraduates will take 
the Te^t of Standard Written English (TSWE) , ^' fkirly new test designed 
to measure basic writing skillp. Since this latter test is not designed 
fot non-native $peakec8, the results achieved by such subjects will 
provide information^ about^^he use£uln^^s j>f the TSWE for measuring pro- 
ficiency in Engli^sh as a second language. An additional feature of this ' 
.study will Be the attempt to give an evaluation of the appropriateness 
of tests such as the GRE and the SAT based on examination of the tests by 

^ selected ESL- specialists. , - - 

This stu^y aa ^descryibed will be carried out during* the current \. 
spring and-sumner with a report o| the findings available by late 1977. 
In 'general, the results .of my study relating the TOEFL, and GRE tests 'as 
well as the hypothesis behind the larger scale study to be carried out ' - 
by ETS would seem to be that tests such as the GRE are inappropriate for 
•non-native speakers*.^ Fyt^thermore, the nature of such tests as aptitude 
'measures render them as Inadequate devices for determining language^ 
plroficiency, particularly in a second language context. . . * 

But what about the question of intelligefice' factors As measured ty 
tests using the students' own language or tests wliich do not depend 
strictly oh language? In a paper entitled "The, Relatioiiship Betseen 
Foreign Language Proficiency and Varloas. Psychological V&riables^ Mats 
Oskarssdn. (1975)rhas reported on a project in Sweden which attempted to' 
examine ^the relationship between ^e«^ond language proficiency (English) 
and various intelligence factors si^h as. general verbal comprehension, 
ability to dr^w logical conclusio^ and ability to perceT.ve spatial 
relations. Although the intelligfenpe tes£s were conducted in Swedish, " 

•the pat ive, language of the btude^ts, their relationship with the language 
tests was not very great. The Highest correlation coefficient achieved 
(.37) was between the sentenceycombining portion of the English language 
test and tlie section of, the intelligence test. using opposites. AJ.1 
other Coefficients were lower/, some as low as .13V 

In another portion'of the satoe study reading comprehension skilds 
were cottpalred with thd saiM battery of intelligence tests. Although' the 
overall correlation coefficients ar^once again fairly low, it is 
interesting to note that *)ne_ test, that which test fed induction and logic, 
deemed to relate much iv)re to reading proficiency than any of the others 
(.67). Oskardson's cotie;ius;lon,. i>hat* "success on readirtfe coibprehensioif 
t«sts consisting of texts followed/by multiple^r-choice questions is to 
spmev if not a large, extent dependent on induftlve an|] logical reasonin 
abilities** would seem to support some of our earlier comments with regar 
to the results of the/TOEFL native sQeaker Mudy. 

The OskarfifSon sf udy also compared the Eng^sh test results with 
those from a number of tes^s evaluating certain personality traits, 
again the correlafion coefficients were low but tHe one Interesting 
relationship/is shown ^.n the negative correlation (-.33) l>etween th 
English lanflfba^e %eBt scores ^and those on the test of^'deliberatene«^_ 
Th^.s would ieemi fc^tf ^indicate that the .^person who is. more' deliberate/ or 
careful about lisin^ a seeded language will be least successful in/doing 
so. In testing terms Oskarason cites this as evidence that the persox^ 
**Who tends to fonder for too long over which option to pick In multipla 
choice items is more likely to go wrong than the person' who acts on 
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\n flunSary, then< we have reeti how in^elligepce factors and langyage^ 
fetors overlap In tests dedlgncdMo moasur^e^lnnRuage or f qt^^tligence* * 
This 1« no doubt a reflection of /the nrt.iial tntfer;play of such factors 

• within the human brain. But the prdblem co|ies ^ when we make judgments 
about language on the- basis of test data which are primarily ciirected 
toward evaluating Intellifeenc^ /or vice-versit. Despite the ovetlap, the 

. two are not* the^ ^ame. As Glucksberg and Daijiks (1975) have wisely* stated, 
••condeptyal competence cannot/be^ferred fiom lingulistic .competence 

. Much more investigation is. jteeded of t^e relationship- between > 
language and intrtligence. In particular, ^hat is ne^ed is joint 
. research on this question by linguist?,* psychologists and sprecialists - 
in measurement. Given .our present knowledge, however,! we can only 
wonder whether from an, administrator 's point of view (^mlsdions and^ 

* placement in particular) the number of tests frequently ^requiretl o| 
non-native speakers hel^^ or hitlers the attempt to arriVe, at a meaning- 
ful description of eithe^: linguistic or intellectual competence. Like- 
wise, from 'the point of view of thie, students who* take these t^ests the 
purpose and scope of these variotiV tests is not clfear. Put mare , 
suc^ntly, the title of this* paper represents thS Jproblem—langua^e 
testing and intelligence testing: friends or- f oeW? . | 
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